User interface panel

ABSTRACT

The present disclosure provides a method of modifying a user interface on a display relative to a user, comprising: detecting a position of a user&#39;s eyes relative to a user interface (UI) viewing surface, wherein the detecting includes sensors selected from the group consisting of proximity sensors, web cams, and face recognition scanners; wherein the detecting further includes detecting the position of the user&#39;s eyes relative to the user interface; adjusting the UI&#39;s viewing surface for altered viewing based on the position of the user&#39;s eyes; and, wherein the adjusting comprises a software algorithm for switching on and off semi-transparent pixels in the UI viewing surface for viewing the UI by the user at a viewing angle from about 20 degrees to about 90 degrees.

BACKGROUND

In today's digital world, the use of graphic user interfaces (GUIs) todisplay and manage information has become ubiquitous. For example,operating systems used in many personal computers, printers, copiers,electronic devices, etc., employ a graphic user interface (GUI) thatdisplays information (e.g., text, images, etc.) for a user to view, andprovides various icons or indicia with which the user may interact(e.g., a button, an Internet link, etc.). Software applications in thesesystems count on knowing, in advance, the typical position from whichthe user will be viewing the display screen, and will arrange and orienttheir graphical elements accordingly. For example, for a typicalcopier/printer, the applications assume that the user will be viewingthe display at a typical viewing angle with one particular edge being atthe “top,” and will orient text and images with that orientation inmind.

New applications or displays opened on the system assume the sameorientation for the display, and present their information aligned inthe same manner as other applications (e.g., they share the sameunderstanding of “up” and “down” and display angle as other applicationson the system). This allows the same user to easily and accurately seethe information for the various applications. However, such arrangementsmay include drawbacks.

BRIEF SUMMARY

In one aspect of the disclosure, a method of modifying a user interfaceon a display relative to a user is provided, comprising: detecting aposition of a user's eyes relative to a user interface (UI) viewingsurface, wherein the detecting includes sensors selected from the groupconsisting of proximity sensors, web cams, and face recognitionscanners; wherein the detecting further includes detecting the positionof the user's eyes relative to the user interface; adjusting the UI'sviewing surface for altered viewing based on the position of the user'seyes; and, wherein the adjusting comprises a software algorithm forswitching on and off semi-transparent pixels in the UI viewing surfacefor viewing the UI by the user at a viewing angle from about 20 degreesto about 90 degrees.

In another aspect of the disclosure, a method of modifying a userinterface on a display relative to a user, comprising: detecting aposition of a user's eyes relative to a user interface (UI) viewingsurface, wherein the detecting includes sensors selected from the groupconsisting of proximity sensors, web cams, and face recognition scanner.The method further comprises: detecting the position of the users eyesrelative to the user interface; adjusting the UI's viewing surface foraltered viewing based on the position of the user's eyes, wherein theadjusting comprises a software algorithm for switching on and offsemi-transparent pixels in the UI viewing surface for viewing the UI bythe user at a viewing angle from about 20 degrees to about 90 degrees;and, a series of polarizing films wherein the algorithm determines whichpolarizing films to activate to alter the UI display based on theposition of the user.

In yet another aspect of the disclosure, an apparatus is provided formodifying a user interface on a display relative to a user, comprising:a sensor for detecting a position of a user relative to a user interface(UI) viewing surface; wherein the sensor is selected from the groupconsisting of proximity sensors, web cams, and face recognitionscanners; and, wherein the detecting includes detecting the position ofa user's eyes relative to the user interface. The apparatus furthercomprises: a software algorithm for switching on and offsemi-transparent pixels in the UI viewing surface for adjusting the UI'sviewing surface for viewing the UI by the user at a viewing angle fromabout 20 degrees to about 90 degrees; and, a series of polarizing filmswherein the algorithm determines which polarizing films to activate tofurther adjust the UI display based on the position of the user.

In still a further aspect of the invention, a method is provided fororienting a user interface on a display to a user, comprising: detectinga position of a user's eyes relative to a user interface (UI) viewingsurface, wherein the detecting includes sensors selected from the groupconsisting of proximity sensors, web cams, and face recognitionscanners; and, wherein the detecting further includes detecting theposition of the user's eyes relative to the user interface. The methodfurther comprises: adjusting the UI's viewing surface for optimalviewing based on the position of the user's eyes; and, wherein theadjusting comprises a software algorithm for switching on and offsemi-transparent pixels in the UI viewing surface for viewing the UI bythe user at a viewing angle from about 20 degrees to about 90 degrees.

Yet further, a method of modifying a user interface on a displayrelative to a user is provided, comprising: detecting a position of auser's eyes relative to a user interface (UI) viewing surface; whereinthe detecting includes sensors selected from the group consisting ofproximity sensors, web cams, and face recognition scanner; and, whereinthe detecting includes detecting the position of the users eyes relativeto the user interface. The method further comprises: adjusting the UI'sviewing surface for altered viewing based on the position of the user'seyes; wherein the adjusting comprises a software algorithm for switchingon and off semi-transparent pixels in the UI viewing surface for viewingthe UI by the user at a viewing angle from about 20 degrees to about 90degrees; and, a series of polarizing films wherein the algorithmdetermines which polarizing films to activate to alter the UI displaybased on the position of the user.

And still further, an apparatus for modifying a user interface on adisplay relative to a user is provided, comprising: a sensor fordetecting a position of a user relative to a user interface (UI) viewingsurface; wherein the sensor is selected from the group consisting ofproximity sensors, web cams, and face recognition scanners; and, whereinthe detecting includes detecting the position of a user's eyes relativeto the user interface. The apparatus further comprises: a softwarealgorithm for switching on and off semi-transparent pixels in the UIviewing surface for adjusting the UI's viewing surface for viewing theUI by the user at a viewing angle from about 20 degrees to about 90degrees; and, a series of polarizing films wherein the algorithmdetermines which polarizing films to activate to further adjust the UIdisplay based on the position of the user.

BRIEF DESCRIPTION OF THE DRAWINGS

Various of the above-mentioned and further features and advantages willbe apparent from the specific apparatus and its operation described inthe example(s) below, as well as the claims. Thus the present disclosurewill be better understood from this description of an embodimentthereof, including the drawing figures wherein:

FIG. 1 is a schematic view of a user's viewing position, including aviewing angle, relative to a display (i.e. a flat panel LCD display);

FIGS. 2A and 2B show a comparison of a typical LCD display at generally90 degrees (2A), and at a typical user's position (2B); and,

FIGS. 3A and 3B show a comparison of a pixel adjusted LCD display atgenerally 90 degrees (3A), and at a typical user's position (3B).

DETAILED DESCRIPTION

The present disclosure relates to a printer apparatus or the like, andmore particularly, to a reconfigurable Graphical User Interface (GUI)for interfacing with such a printer or other GUI.

An interactive user interface display and controller UIT using a cathoderay tube (CRT) or other technology provides, through the associatedsoftware, a substantially flexible, operable, and extensive interface tothe user of complex equipment, such as printers, duplicators, computersand computer controlled machines. However, a problem with the use ofinteractive displays is that the usual horizontal display requires auser to view the horizontal display nearly directly overhead.

Prior attempts at improving displays for a viewer include U.S. Pat. No.4,410,159 that shows an adjustable support for a display terminalproviding a tilt of forty degrees and an infinite angle of swiveladjustment. In U.S. Pat. No. 4,561,619, a system for supporting andmoving a CRT monitor on a horizontal surface is disclosed wherein thesupport is on rollers. The supporting means preferably also includesmeans for tilting and swiveling the monitor. U.S. Pat. No. 4,575,033,discloses a tilt-swivel base for a CRT terminal allowing the monitor tobe rotated, swiveled and tilted readily. A semi-circular rocker drum ismounted on the underside of the terminal. The rocker drum is supportedby a cradle which is inserted in a recess on a horizontal surface. Thelength of the recess is made longer than the length of the cradlethereby enabling the cradle to slide from side to side. A supportingdevice is shown in U.S. Pat. No. 4,659,048, for a data displaying unit,which is rotatable about a vertical axis and displaceable in ahorizontal plane, allowing the distance between the eye and the displayunit to be set for the viewing direction chosen by the operator. U.S.Pat. No. 4,836,478, discloses a suspension system for a monitor whichallows rotation of the monitor around its vertical axis, and pivotingand tilting of the monitor. The monitor may also be moved laterally.These patents do not answer the problems heretofore mentioned withrespect to displaying a GUI using manipulated pixels, polarizing films,and/or display angles to improve the readability of the horizontal, ornearly horizontal, GUI to the user.

Mechanical arms may address these problems through the use of a singledisplay, but have inherent problems. Single arm supported displays maybe limited in their ability to achieve ergonomically optimal placementas the display tracks on an arc of a circle. Articulated arms employingmultiple pivot points, four bar linkages and the like can achieve greatflexibility in display placement, but require precision parts and highstrength to handle larger, heavier displays without appreciable wobble.Mechanical arms appear to use space that could be otherwise productivewithin the system or through less space for installation of the system.The swing arm mechanism and the heavy swinging object presents operatorhazards and added component costs.

Existing products typically have a UI (User Interface) that is set at afixed angle of presentation to the user. This means that the user mustoptimally position themselves in the same place in order to view thescreen. The position is dependent on various attributes relating to theuser (e.g., height) and, in some instances, creates problems for theuser, specifically those with some form of disability or medical problem(i.e. neck related problems). Referring to FIG. 1, there is shown auser's viewing position 10 relative to an LCD flat panel display 14. Aviewing angle is formed therebetween 16. Allowing the user to vary theviewing angle of the screen and/or varying the viewing display relativeto the user, creates a better user experience.

Many office products, i.e. copiers and printers, have a UI that is inthe same plane as the platen glass and, therefore, requires the user toposition themselves such that their head is directly over (i.e. 90degrees) the UI screen. This can be both restrictive and uncomfortablefor many users. Furthermore, such limited viewing angles hinders use bypeople with disabilities such as those in wheelchairs. It is to beappreciated that as the viewing angle 16 increases, the display becomesless and less readable. To be described in more detail hereinafter,increasing or adjusting the brightness of sub-rendered orsemi-transparent pixels can be implemented to counter the degradation ofthe display relative to the viewing angle.

The UI position is dependent on various attributes relating to both theuser, for example, their height, and the display hardware such as thespecifics of the RGB sub-pixels in LCD and TFT devices. Allowing theuser to optimally view the UI content through a wide range of anglescreates a better user experience while more successfully addressing thequestion of accessibility than solutions heretofore developed.

Accordingly, disclosed herein is a printer for printing copy sheets thatincludes a reconfigurable GUI for controlling its functions. The presentdisclosure, to be described in more detail hereinafter, proposes methodsthat automatically adjust an MFD user interface (UI) according to theviewing angle 16. Many MFD products that have a UI that is in the sameplane as the platen glass have a narrow useful viewing angle 16. Thepresent disclosure proposes to automatically detect the user position10, using methods such as proximity sensors and a camera, and adjust theUI accordingly. The adjustments can be associated with: 1) using anelectro-mechanical tilting mechanism to change the UI surface angle; 2)varying a viewing angle using polarizing films; and/or, 3) optimizingrendering parameters in software, e.g., making gray pixels either fullblack or full white.

The cost of a camera and panel tilting or polarizer control would likelyexceed that of a better LCD panel with a larger viewing angle, but therendering software variant according to adjustment (3) of thisdisclosure can be useful in architectures where a camera is needed forsome other purpose. It is to be appreciated that various renderingparameter changes can be implemented beyond merely font changesdescribed in the present disclosure. For example, the image could bestretched vertically to accommodate a steeper viewing angle (likemarkings on the surface of a roadway). In addition, other applicationsof the present disclosure can include such devices as laptops and cellphones.

As introduced above, the user can be provided with the ability to adjustthe display of the UI screen. This can be done in several different wayseither singularly or in combination, for example: mechanically, i.e. anelectromechanical tilt mechanism; electronically, i.e. polarizing films;and/or, through software, i.e. changing the color palette, contrast,backlight, graphics transparency layers, etc., to compensate for thehardware emissivity characteristics (and reflective properties)throughout the full range of various viewing angles.

This disclosure does not limit the methods for detecting the user'sposition relative to the UI, but rather provides for a means to bringtwo or more separate technologies together. There are several exemplarymethods known for sensing the position of the user, such as thoseemploying simple proximity sensors to those which employ web cams andface recognition software to detect exactly where the user's eyes are inrelation to the UI.

In one adjusting method, a tilt mechanism solution can include the angleof the UI's viewing surface being adjusted for optimal viewing based onsensing the position of the user. A software algorithm can control anelectromechanical tilting mechanism that the UI is seated on. Theelectromechanical tilt mechanism can move or tilt the viewing surface toprovide for a nearly perpendicular orientation relative to the user'sline of sight.

In another adjusting method, an electronic technology solution caninclude varying the optimal viewing plane of a display. Polarising filmsare one example of how viewing angles can be adjusted in a dynamicarrangement. By adopting a software algorithm for determining whichpolarizing film (for example) should be active and then activating itbased on the position of the user, the user does not have to positionthemselves in the optimal position determined by the mounting.

In yet another adjusting method, a software solution can include changesto the display such as ‘anti-aliasing’. This type of change to thedisplay is used to smooth fonts which can be severely adversely affectedby the hardware characteristics. Typically in the case of a touch screenUI, the contrast and brightness rapidly degenerates as the viewing anglemoves away from 90 degrees (FIGS. 2A and 2B). Semi transparent pixelsthat appear on the 90 degree plane (2A) completely disappear when viewedon another plane (2B). As shown in FIG. 2A, font characters 20, 22appear well defined when viewed at 90 degrees 25. As shown in FIG. 2B,the same characters 30, 32, when viewed at a less than 90 degree angle35, appear less defined. Anti-aliased pixels within characters 30, 32disappear when viewed from a typical user's position and the fontcharacters break down (i.e. are not fully readable). To overcome theaforementioned problem, one embodiment provides for a simple algorithmto turn on some of the semi-transparent pixels. The basic conceptprovides for the switching on of pixels that are being used inanti-aliasing. The brightness threshold that the pixel must be abovebefore being switched fully on reduces as the viewing angle increases.This relationship is typically specific to the associated LCD hardwarebeing used.

In another embodiment, a sub-pixel rendering algorithm can beimplemented without user position detection. For example, with sub-pixelrendering switched off and selected pixels switched on, the display isreadable at 90 degrees (FIG. 3A) and also readable at less than 90degrees (FIG. 3B). As shown in FIG. 3A, font characters 40, 42 appearwell defined when viewed at 90 degrees 45. As shown in FIG. 3B, the samecharacters 50, 52, when viewed at a less than 90 degree angle 55,maintain a defined appearance.

By adjusting the threshold that the semi transparent pixels are switchedfully on or fully off, the font can again become readable at extremeangles. However, when viewed at 90 degrees, the font is very ‘blocky’,pixilated and difficult to read. A usable threshold can be ascertainedto accommodate extreme viewing positions. By just adjusting theaforementioned threshold alone, based on the user's position, one cansignificantly improve the display and thus the viewing experience. Theadjustment also reduces the effect of glare because the contrast remainsoptimal and thus allows the eyes to focus on a specific spot on the UIand not on the glare image. Two example algorithms or adjustments are asfollows:

1) Pixel enablement threshold=128*—degrees from normal; and,

2) Backlight co-effic.=128*—degrees from normal.

Some of the aforementioned principles can be extended in a manner tovariably and dynamically adjust values that were previously constants inrendering areas such as changing the color palette, contrast, backlight,graphics transparency layers, etc.

It will be appreciated that variants of the above-disclosed and otherfeatures and functions, or alternatives thereof, may be combined intomany other different systems or applications. Various presentlyunforeseen or unanticipated alternatives, modifications, variations orimprovements therein may be subsequently made by those skilled in theart which are also intended to be encompassed by the following claims.

What is claimed is:
 1. A method of modifying a user interface on adisplay relative to a user, comprising: detecting a position of a user'seyes relative to a user interface (UI) viewing surface; wherein saiddetecting includes sensors selected from the group consisting ofproximity sensors, web cams, and face recognition scanners; wherein saiddetecting further includes detecting said position of said user's eyesrelative to said user interface; adjusting said UI viewing surface foraltered viewing based on said position of said user's eyes; wherein saidadjusting comprises a software algorithm for switching on and offsemi-transparent pixels in the UI viewing surface for viewing said UIviewing surface by said user at a viewing angle; wherein said UI viewingsurface is initially in a substantially horizontal plane, wherein saidhorizontal plane is generally parallel to a floor and wherein saidpixels are adjusted automatically based upon said position of saiduser's eyes; wherein said viewing angle is formed between a user'sviewing position, said UI viewing surface, and a plane orthogonal tosaid UI viewing surface; and, wherein said viewing angle decreases assaid user approaches said UI viewing surface.
 2. The method of claim 1,further comprising: a software algorithm and polarizing films whereinsaid algorithm determines which polarizing films to activate to altersaid UI display based on said position of said user's eyes.
 3. Themethod of claim 1, wherein said adjusting is done dynamically as saiduser's position changes.
 4. The method of claim 1, further comprisingadjusting an angle of said UI's viewing surface for optimal viewingbased on said position of said user's eyes.
 5. The method of claim 4,further comprising a software algorithm for controlling anelectromechanical tilting mechanism for adjusting said angle of saidUI's viewing surface.
 6. The method of claim 4, further comprising asoftware algorithm for controlling an electromechanical tiltingmechanism for adjusting said angle of said LA's viewing surface.
 7. Themethod of claim 2, further comprising a software algorithm for switchingon and off semi-transparent pixels in the UI viewing surface for viewingsaid UI by said user, wherein said UI viewing surface is horizontal andwherein said pixels are adjusted automatically based upon said positionof said user's eyes.
 8. The method of claim 7, wherein said adjusting isdone dynamically as said user's position changes.
 9. A method ofmodifying a user interface on a display relative to a user, comprising:detecting a position of a user's eyes relative to a user interface (UI)viewing surface; wherein said detecting includes sensors selected fromthe group consisting of proximity sensors, web cams, and facerecognition scanner; wherein said detecting includes detecting saidposition of said users eyes relative to said user interface; adjustingsaid UI viewing surface for altered viewing based on said position ofsaid user's eyes; wherein said adjusting comprises a software algorithmfor switching on and off semi-transparent pixels in the UI viewingsurface for viewing said UI viewing surface by said user at a viewingangle; a series of polarizing films wherein said algorithm determineswhich polarizing films to activate to alter said UI viewing surfacedisplay based on the position of said user; wherein said UI viewingsurface is initially in a substantially horizontal plane, wherein saidhorizontal plane is generally parallel to a floor; wherein said viewingangle is formed between a user's viewing position, said UI viewingsurface, and a plane orthogonal to said UI viewing surface; and, whereinsaid viewing angle decreases as said user approaches said UI viewingsurface.
 10. The method of claim 9, wherein said pixels are semitransparent pixels and are adjusted automatically based upon said user'sposition wherein said adjusting includes determining a threshold wheresaid transparent pixels are switched fully on or fully off.
 11. Themethod of claim 10, wherein said pixels are adjusted automatically basedupon said position of said user's eyes.
 12. The method of claim 11,wherein said adjusting is done dynamically as said user's positionchanges.
 13. The method of claim 12, wherein said threshold is based onsaid position of said user's eyes.
 14. The method of claim 13, furthercomprising a software algorithm for controlling an electromechanicaltilting mechanism for adjusting said angle of said UI's viewing surface.15. The method of claim 9, wherein said adjusting comprises adjustingvalues from the group consisting of color palette, contrast, backlight,and graphic transparency layers.
 16. A method of orienting a userinterface on a display to a user, comprising: detecting a position of auser's eyes relative to a user interface (UI) viewing surface; whereinsaid UI viewing surface is initially in a substantially horizontalplane, wherein said horizontal plane is generally parallel to a floor;wherein said detecting includes sensors selected from the groupconsisting of proximity sensors, web cams, and face recognitionscanners; wherein said detecting further includes detecting saidposition of said user's eyes relative to said user interface; adjustingsaid UI viewing surface for optimal viewing based on said position ofsaid user's eyes; wherein said adjusting comprises a software algorithmfor switching on and off semi-transparent pixels in the UI viewingsurface for viewing said UI viewing surface by said user at a viewingangle from about 20 degrees to about 90 degrees; wherein said viewingangle is formed between a user's viewing position, said UI viewingsurface, and a plane orthogonal to said UI viewing surface; and, whereinsaid viewing angle decreases as said user approaches said UI viewingsurface.